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(57) ABSTRACT 

An apparatus and method is disclosed for providing a user 
with task-specific information that includes a portable 
instruction system that may be worn by a user, and includes, 
a computer sufficiently lightweight and designed to be worn 
by a user to which a memory has been connected. The 
system includes a display device that can receive display 
signals from the computer for visual display to the user and 
an input device by which the tiser enters commands to the 
computer. An instructional program is provided that the 
computer accesses and stores in memory in response to a 
user command and displays information concerning a task to 
be performed by the user on the display device in response 
to commands from the user. 

23 Claims, 8 Drawing Sheets 
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SYSTEM, APPARATUS AND METHOD FOR 
PROVIDING A PORTABLE CUSTOMIZABLE 
MAINTENANCE SUPPORT INSTRUCTION 
SYSTEM 

5 

This application is a conversion of U.S. Provisional 
AppHcation Ser. No. 60/126,759, filed Mar. 29, 1999. 

TECHNICAL FIELD OF THE INVENTIGN 

The present invention relates in general to the field of lo 
real-time instruction and maintenance support, and more 
particularly, lo the use of a portable system, apparatus and 
method for the remote repair or maintenance of complex 
mechanical systems that is hands-free and which is customi- 
zable on-site for a particular piece of equipment, process, 15 
operation or system. 

BACKGROUND OF THE INVENTION 

Without limiting the scope of the invention, its back- 
ground is described in connection with a portable computer 
for use during repair, support and maintenance support 
operations, as an example. 

In order to remain competitive, many industries, such as 
the aircraft industry, have increasingly automated their 
assembly processes through the use of computer-controlled 25 
equipment. The increase in complexity of the mechanical 
and computer systems in the airline, automobile, and other 
industries that rely heavily on automation, have led to the 
need for an increasingly sophisticated labor force. 
Unfortunately, the labor markets are failing to meet the 3Q 
demand for highly competent repair and maintenance 
employees at reduced costs. As equipment becomes more 
complex, the diagnosis of faults and maintenance of the 
equipment have, likewise, become more complex. 

During the repair and maintenance process, operators are 35 
often responsible for diagnosing and resolving problems. 
Since the processing that occurs with a fully functional piece 
of equipment is stopped during the repair and maintenance 
time, it is important that the operator diagnose and resolve 
the fault expeditiously. The problem is further enhanced by 40 
the need for specialized labor that often must be brought 
from a remote site or another city to perform the repair 
procedure. 

In the case of preventative maintenance, a similar problem 
to that of repair work is the need to file reports detailing the 45 
procedures and repairs accomplished. Part of the task of 
reporting repair and maintenance work is the need to specify 
the parts replaced, as well as, reordering of new parts to 
maintain in inventory. Typically, preventative maintenance 
is scheduled based upon manufacturer estimates for the 50 
Hfetimc of various components. In order to accurately and 
completely follow and maintain these schedules, the opera- 
tor must not only be we 11 -versed in both equipment part 
location and maintenance procedures, but in correctly filing- 
out and filing the reports in a timely manner. 55 

Furthermore, the reporting process must allow the user 
and others to retrieve, view, enhance, and interpret the 
information. One such procedure is to dictate or "annotate" 
the diagnosis to produce a final report that may be accessed 
by other maintenance personnel. More modem systems, 60 
such as those in medical record keeping, involve the use of 
multiple media data with static graphic drawings on the 
report. These prior art techniques, however, use visual 
annotations to annotate process and procedures along with 
the annotators voice, and to playback the recorded result. 65 
Then, the annotations must be transcribed manually in order 
to produce a complete report. 
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A system for repair is disclosed in U.S. Pat. No. 5,754, 
451, issued to Williams entitled, "Preventative Maintenance 
and Diagnostic System". WiUiams discloses a maintenance 
system for a machine controlled by a programmable logic 
controller having a memory that stores input data received 
firom the machine and output data communicated to the 
machine. The maintenance system includes a computer 
interfaced to the memory to be non- intrusive with respect to 
the programmable logic controller; the computer being 
operative to monitor a state of the machine over a plurality 
of manufacturing cycles, including input and output data. 
The computer is able to detect a fault condition for a 
component of the machine based upon a state of a current 
manufacturing cycle and a state of a previous manufacturing 
cycle. A display device is in communication with the com- 
puter to alert an operator of the fault condition and to 
graphically display a location of the component within the 
machine to facilitate a corrective measure by the operator. 
One problem with the prior art, however, is that the operator 
is always tethered to the computer and must provide com- 
mands through a keyboard or like device. Furthermore, the 
maintenance instructions are native to the machine that is in 
need of repair or maintenance, requiring that it be in the "on" 
position during maintenance. Yet another problem with the 
invention as described is that the machine in need of repair 
must have been pre-programmed to respond to the mainte- 
nance requiremeDls of the hard wire tether and be able to 
communicate with the computer to which the machine is 
tethered. 

For existing systems in the repair and maintenance 
industry, or within industries in need of highly specialized 
on-site repair and maintenance personnel, there is presently 
no system, apparatus or method of providing multimedia 
data acquisition, interpretation, instruction and reporting. 

SUMMARY OF THE INVENTION 

The present invention provides a light, portable hands-ofif 
or hands-free maintenance and repair system, using a task- 
specific hypertexted, animated, voice-synthesized, and/or 
voice-activated communications and search engine that is 
able to access a task-specific database. The instructional 
program or engine is made task-specific by accessing a 
database of machine, process or operational specific data, 
which may be computer data, audio and even video clips that 
provide the user with real-time instructional information 
about the task or tasks that the user is to perform at a remote 
location. 

The computer device is sufficiently lightweight to use at 
the remote location and provides hands-free command of the 
engine and access to the task-specific database so that the 
user may perform maintenance and repair on the machine, 
process or operation with the use of both hands. The 
task-specific information may include technical views and 
design diagrams of the machine, process flow or operation. 
The task-specific data will also provide instruction for 
accessing the machine, process or operation and be dis- 
played to the viewer through a display device that may be, 
e.g., a head set with partial view of the operation and of the 
computer display or may even be a hand-held display that 
the user positions within the user's view. 

The present invention includes an information retrieval 
and input system for displaying task-specific data, with a 
computer having an input/output device, access to a large 
capacity information storage and a retrieval device inter- 
faced with the input/output device adapted to receive a 
memory medium containing the predetermined digitized 
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data. The storage and retrieval device is adapted to access In one embodiment of the present invention, the portable 

the task-specific data on the memory medium and to provide instructiooal system that may be worn by a user may also be 

the data to the input/output device, the predetermined digi- described as having a computer of a size sufiBciently small 

tized data may be organized in, e.g., a hypertext format. to be carried by a user to which a memory is connected to 

Hypertext may be accessed direoUy through a hypertext 5 and under control of the computer. A display device that can 

engine or via software written to access hypertext-based '^'^^.^^^ display signals &om the computer for visual display 

data, as well as data in other formats, e.g., in Microsoft ""P"* device by which &e user eaters 

Access or D-Base format. Audio and video input and output "'"^f'^iids to the coniputer is also provided. Tlie instruc- 

devices may be included in a headset adapted to be worn by ^""""^ P™Stam that the computer accesses and stores in 

the user. The head mounted image display is supported by lO memory contains instructional mfcrmation conccrmng a 

the headset having a virtual image display having one or be performed by the user The system may also 

more eye-pieces adapted to be positioned within the view of "^'^"''^ ^,^1° °^ ^ size sufficiently smaU to be worn 

the user while performing a specific Usk thereby providing °' hand-held by a user connected to the system that transmits 

video display information from the computer to the user in ^^^^^ "^"^ "^""/^ '''^ 

a hands-free, Ughtweight manner. 15 \ communicaUons system, whereby the user can com- 

„ , , . ,. . municate with an assistant viewmg the images at the remote 

The task-spccific storage and retrieval mstnictional pro- ,it^ coQceming the task being performed. 

gram of the present invention provides read/wnte capability -m.-**- * -ij^. ^ r 

c ^ t 11 i_ J ■ r The instruction system may include a first computer of a 

tor task-specific data, as well as. hands-free voice recoeni- • a= ■ .1 n ^ l u 1 • 1 ■ 

^. r .J. , r? . • . 1 vn size sufiHciently small to be worn by a user which is 

tion tor providmg access to data that is task-specific on a .ir 

^j. ^ .J ijrm . 90 connected to a memory connected to and under control of 

storage medium or via download. The system provided , , a 1 ^ • * -j ^ .t. . 

. . . , c ^ ^ r\ 1/ . f first computer A display device is provided that can 

herein may be part of a network. One such system for use • j-i i^r .uc. . ^ 

ui * c ,u . • . • • receive display signals fi-om the first computer for visual 

with the portable computer of the present invention isa j i ^ H ■ • ■ l .-i.., 

* i juu j -1 . . ."r display to the user as IS aninput device by which the user 

network card, which provides a wireless computer interface / j * *u ^ * . 4^. - . 1 

^ , f ^ ,^c.r.\ enters commands to the first computer. The mstrucUonal 

with other users or even a customer support center (CSC) • j u *u £ * . u - i_ 

, J . . , , - , . . i 25 program is accessed by the first computer, which the corn- 
connected through a wireless antenna, through a hard-wu:ed , , ' Tn, / '..-I 
. .1 L- ^- r puter stores iQ memory. The proeram contains instructional 
computer network, or a combination thereof. - c • * 1 * u _f j i_ 

^ mrormation concern mg a task to be performed by the user at 

In operation, the user looks through an eyepiece (or at a location. The system also may include a second computer 

another type of display) to view a virtual image that appears at a remote site from the user's location for use by an 

m front of the eyepiece, creating the illusion of a high- 3^ assistant or supervisor working with the user, which is 

resolution computer screen for view by the user. The user connected to a communications program by which the 

sees an unage that a number of menus and buttons that the second computer receives and displays data from the first 

user accesses by voice-command without the need for a computer, which data is of a type that aids in the perfor- 

movement controlled device such as a mouse or keyboard, ^ance of the task. The first and second computers commu- 

but such a device may be used if voice activation is not 35 nicate through a wireless data transmitting and receiving 

necessary or desired. ^^^^^^ connected to the first computer, which device can 

The display and input devices arc connected to a very transmit data to the station and receive data from the station, 

lightweight computer that accesses data from a large capac- A wireless data transmitting and receiving station having a 

ity storage device, such as internal hard drive and/or a range, which station can transmit data to and receive data 

CD-ROM or DVD-ROM drive and stores user responses on, 40 from the first computer anywhere with the range is also 

for example, a "journal" file on the hard drive. These devices provided. Finally, a communications link is provided by 

may hold the task-specific database(s) that allow the user to which the second computer can send data to and receive data 

make the instructional program task-specific simply by from the wireless station while the user is working on the 

exchanging disks at the remote location. The CD-ROM or task within range of the wireless station, permitting audio 

DVD may be left at the remote site, thereby allowing any 45 and/or video teleconferencing between the user and the 

SIMON user to reach the remote location and access the assistant or supervisor. 

storage medium to access task-specific maintenance and A computer communication system for use with the 

repair information. The data may be transmitted to the user present invention includes a computer of a size sufficiently 

at the remote location via a hard- wire or by wireless trans- small to be worn or hand-held by a user. A display device 

mission. Other mechanisms for downloading information 50 that can receive display signals from the computer for visual 

are also within the scope of the invention, including network display to the user is connected to the computer as is an input 

access, remote access (via telephone lines or otherwise) or device by which the user enters commands to the first 

satelhte-based communication systems. computer. Wireless data is transmitted and received through 

More particularly, the present invention is directed to a a device connected to the computer, which device can 

portable instructional system that includes a computer suf- 55 transmit data to the station and receive data from the station, 

ficiently lightweight and designed so that it may be worn by The wireless data transmitting and receiving station has a 

a user to which a memory has been cormected. The memory range, which station can transmit data to and receive data 

is connected to and under the control of the computer from the first computer anywhere within the range. Also, a 

together with a data storage device such as a hard drive. The computer network that can send data to and receive data 

system also includes a display device that can receive 60 from the wireless station while the user is working on the 

display signals from the computer for visual display to the task within range of the wireless station is provided, 

user and an input device by which the user enters commands Yet another embodiment of the present invention is an 

to the computer. An instructional program is provided that instruction system includes an instructional program that 

the computer accesses and stores in memory in response to controls a computer and is stored in memory, which program 

a user command and displays information concerning a task 65 contains instructional information concerning a task to be 

to be performed by the user on the display device in response performed by a user at a location. An input/output program 

to commands from the user. is also provided that controls the interaction between the 



04/02/2003, EAST Version: 1.03.0002 



us 6,356,437 Bl 

5 6 

computer and a display device and at least one audio input FIG. 9 is a flow chart of the security and administrative 

and output device. A report generating program under the module; 

control of the instructional program aids the user in gener- piG. 10 is a flow chart of the communications module for 

atmg and transmitting an electronic report relating to the connecting to peripherals that connect the present invention 

task performed by the user at a location. Finally, an instruc- 5 with outside sources of commimication; and 

tiooal database under the control of the instructional ^rr^ ii „ a^.,, u -* * *u -j- ^ t c 

. ^. FiG. 11 IS a flow chart of the diagnostics module for ;ise 

program, which database comprises mformation specific to „ ... „ ^^u^a- , c . • 

ru»i!t. c Jt- . t • with one embodiment of the present invention, 

the task to be periormed by a user at a location is provided ^ 

along with a communications program by which the com- DETAILED DESCRIPTION OF THE 

puter communicates data from the computer to a computer lO INVENTION 
network that can receive and transmit data, which data is of 

a type that aids in reporting performance of the task. While the making and using of various embodiments of 

Another embodiment of the present invention is a a the present invention are discussed in detail below, it should 

computer communication system that includes a first com- ^® appreciated that the present invention provides many 
puter of a size sufficiently small to be worn by a user that is 15 applicable inventive concepts which can be embodied in a 

connected to and control a memory and a display and audio variety of specific contexts. The specific embodiments 

device that can receive display signals from the first com- discussed herein are merely illustrative of specific ways to 

puter for visual display to the user and through which the invention and do not delimit the scope of 

user may enters commands to the first computer. The first ^® invention. 

computer is connected to a wireless data transmitting and The present invention is directed to a system, apparatus 

receiving device, which device can transmit digital data to a and method of providing real-time, on-line help to users that 

wireless data receiving and transmitting station, which sla- may need assistance in operating, repairing or maintaining a 

tion is capable of and receiving and transmitting data from complex system. The present invention is not only a 

the station. A second computer of a size suffidently small to complete, interactive, learning repair and maintenance 
be worn by a user is also able to transmit and receive 25 system, it is customizable for the individual machine that is 

wireless data and allows the users of the first and second in need of operator intervention, 

computers to communicate in real-time. The second com- Known as SIMON, for System Integrated Maintenance 
puter is also connected to and controls a memory, and a input Online, the present invention provides the customer or user 
and display device. with a complete online maintenance package for their spe- 
The present invention also includes a method of providing cific system. SIMON enables the user to view pages written 
a user with an instruction system including the steps of in, e.g., HyperText Markup Language (HTML). Mainte- 
providing a user a computer sufficiently lightweight and nance procedures are written in HTML. Context sensitive 
designed to be worn by the user, connecting a memory to, help is available to the user regarding the operations of the 
and under the control of, the computer, displaying on a SIMON engine. A parts search for the customer's parts 
display device display signals from the computer within the database is also available to the user regarding the opera- 
visual range of the user, providing an input device by which tions of the SIMON engine. A parts locator, which enables 
the user enters commands into the computer and accessing a user to locate a specific part, is also available. SIMON also 
an instructional program that the computer stores in memory provide reports, security, communications and learning 
in response to a user command and displays information modules. 

concerning a task to be performed by the user on the display Each customer that uses the SIMON engine for a particu- 

device in response to commands from the user. hr machine, operation or process determines which modules 

BRIEF DESCRIPTION OF THE DRAWINGS rj^Jn^J ^t°colTo^^^^^^^^ 

For a more complete understanding of the features and to the customer's specification equipment, version, machine 

advantages of the present invention, reference is now made process or operation. SIMON recognizes voice, mouse, 

to the detailed description of the invention along with the keyboard and touch screen input, and may also use the 

accompanying figures in which corresponding numerals in default windows screen data. 

the different figures refer to corresponding parts and in One type of computer system that may be used with the 

which: SIMON system is described in U.S. Pat. No. 5,844,824, 

FIG. 1 is a diagram of the basic components of the system issued to Newman, et al., the relevant portions of which are 

disclosed herein; incorporated herein by reference. Newman discloses a por- 

HG. 2 is flow chart of the interactive components or tion of a hands-free, portable computer and system that may 

modules of the SIMON engine and system as they relate to present invention. The body-worn or 
a user performing a task- 5S Portable system includes a hands-free computer system. The 

FIG. 3 is a fast flow chart of a basic operating system and '5«tein does not rely upon a keyboard input or activation 

main application of the present invention; apparahjs but rather has vanous activation means, which are 

„^ f . , „ , ^ . . generally hands-free. 

FIG. 4 IS a second now chart of the main application and -m. . ^ ., ■ ■ . , . . 

its relation to various modules; . '^"^ °f ""^ P^«**°' mvenUon may be used with 
. ■ o L e , ■ ,60 oiner systems, other system components and communicatioD 

moMe- " * mamtenance procedures apparatus as described herein. Also, various components of 

^' the present system may be body worn or placed in a 

FIG. 6 IS a flow chart of the help module; disconnected location if desired. 

no. 7 is a flow chart of the parts search module of the Another such computer system is disclosed in U.S. Pat. 

invention; g5 5,581,492, enUtled "Flexible Wearable Computer", 

FIG. 8 is a flow chart of a basic reports module for use issued to Janik. The relevant portions of the Janik patent are 

with the invention; incorporated herein by reference. Janik discloses a flexible 
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wearable computer in the form of a belt that combines a 
computer that includes a microprocessor module, a RAM- 
I/0 module^ memory modules, a power supply module, and 
bus termination modules that are connected with flexible 
signal wires. The computing elemeats are physically 
attached to a flexible non-stretchable belt or hamess, and 
may also include a protective cover. For example, the 
computer may be powered by an 8 hour six volt power 
supply. Tlie power supply may be a modular battery that is 
worn as part of a hamess or on a belt. The flexible non- 
stretchable wearable belt or harness may be secured around 
various parts of the body. The input and output device or 
devices are connected to the flexible wearable computer by 
the I/O bus attached to the output and input ports. 

The portable computer hardware for use with the present 
invention may be implemented in many different ways. For 
example, each module may form part of a solid thermoset 
plastic casing. Alternatively, a two-part hard plastic shell 
may be used to encase a mother or one or more sister-boards 
having thereon the computer components, input/output 
devices, control devices and the hke. 

The components and support circuitry needed will gen- 
erally be surface mounted based on size and soldered to a 
mother or sister-board. The components may, alternatively, 
be affixed to the circuit board with a conductive epoxy or 
other conductive plastic. The computer may be made even 
thinner and more flexible using chip-on-board and or chip- 
on-chip manufacturing technology. Each integrated circuit 
may be bonded directly to a small printed circuit board and 
the terminals may be electrically connected to the board. 
Each integrated circuit may also be covered with a heat 
radiating element to reduce heating of the integrated circuit 
and increase heat dissipation. 

The computer may be implemented as one long multilayer 
poly amide flexible, or rigid-flex, printed circuit board. As an 
entirely flexible printed circuit board, the modules that form 
part of the computer system increase the rigidity and dura- 
bflity of the portions of the computer with electronic com- 
ponents. 

To interconnect within a computer component or among 
the different integrated circuit components or even from one 
components (See FIG. 1, e.g., the computer 102) to a 
separate component of the flexible portable computer (See 
FIG. 1, e.g., storage medium 122) flexible metalKc wires or 
even non-metaUic electrically conductive filaments or wires 
may be used. The same holds true for the connections 
between the computer hardware and the communications 
devices and/or the head gear and communications devices 
thereon. The computer may even be implemented using fiber 
optic device connections. For such a connection, optical 
fiber filaments instead of metallic or non-metalfic conduc- 
tors are used with photosensitive detectors at each end of the 
filament that communicate the optical signal. One advantage 
or flexible wires or optical connections is that they are easily 
replaced when worn or may even be disconnected and 
connected to another device, such as another head gear or 
even a stand-alone computer. 

Furthermore, the configuration of the flexible portable 
computer need not be in a belt but may be part of a harness, 
thereby causing a better distribution of the weight of the 
components during use. The module and bus assembly may 
be fashioned in a variety of ways such as a vest. When worn 
as a vest, the hamess that contains or holds the flexible 
computer may even be adapted to look Uke normal uniforms 
or clothing, thereby increasing comfort. 

Input and output devices for use with the flexible com- 
puter may include, for example, a touch sensitive flexible 
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liquid crystal display (LCD) hanging firom a belt or even 
wora on a forearm or thigh. The wearer controls the com- 
puter by touching virtual graphical elements on an LCD with 
either the right or left band. An added advantage of this 

5 design is that individuals that are, for one reason or another, 
physically chaUenged may benefit from the avatlabUity of a 
fiilly integrated bands-off or even hands-on flexible portable 
computer. A pen-based input and output device may also be 
used, in combination with, e.g., a Pahn Pilot or other 
hand-held device that may interface with the portable com- 
puter and the SIMON engine. For example, the pen location 
data is sent to the computer via an infra-red fink or hard 
connection and the computer sends corresponding graphical 
information to the pen-based input and output device. 

Another possible configuration for the portable computer 
for use with the invention is using a free-space pointer input 
device and a private eye heads-up display as the output 
device. A free-space pointer, such as a GyroPoint, translates 
relative three-dimensional motion of the hand into digital 
pulses that are monitored by the computer. Software drivers 
translate the digital pulses into corresponding movements of 
the cursor in the virtual screen generated by the heads-up 
display. Both the free -space pointer and the heads-up display 
may be connected to the computer via tethers, thin wires or 

^ opticaUy. 

The present invention also includes connections via wire- 
less transmission to a Local Area Network (LAN) or a Wide 
Area Network (WAN). A wireless transceiver, e.g., a Wave- 
Lan® wireless network IEEE 802.11 card (Lucent 

3Q Technologies), may be functionafly connected to the com- 
puter to provide for digital communications to a wireless 
network backbone. The transceiver communicates via radio - 
frequency pulses, which may also incorporate echo handling 
capabilities for delay spread. One or more wireless repeaters 

35 and or transceivers may be mounted over the work envi- 
ronment in which the portable computer is worn and used. 
Security features may also be included in the wireless 
communication such as data encryption. 
Wireless communication may also be via infra-red 

40 signals, however, this method generally requires line-of- 
sight contact between the receiver/transceiver and the 
antenna or detector on the floor, waU or ceiling. Existing 
LANs or WANs may be easily retrofitted to add wireless 
communication capabilities without the need for rewiring. 

45 Also, the wireless communication may allow SIMON 
users to communicate peer to peer during repair and main- 
tenance operations directly or through a network. With the 
addition of a LAN/WAN based outdoor antenna, the present 
system may even be used to communicate SIMON users in 

50 two separate buildings or even in remote locations. The 
LAN/WAN commxmications network connection may also 
be used to connect to an intranet or the internet to commu- 
nicate with remote sites within a same group or corporation 
to communicate to a centralized consumer support center 

55 (CSC). 

An audio output device may include one or more 
earphones, such as a headset. An audio input device such as 
a microphone is provided for receiving voice commands. 
Real-time text to speech conversion may be provided using 

60 commercially available voice -recognition software, e.g., 
Dragon NaturaUy Speaking. The microphone is adapted to 
receive speech data from the computer and to provide audio 
input to the earphone. The microphone may even be a lapel 
wora microphone such as an Elcctret microphone from 

65 Gentex. Alight weight headset having an earphone, micro- 
phone and a video display may be provided in combination 
and connected to the computer. 
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FIG. 1 shows the compooents and features of a portable hard wire connection 144 to a central server 146, which is 

computer 100 for use with the present invention as it is worn in turn connected to the CSC by ISDN lines. The central 

by a user. A computer 102 may include a housing and be server may be located in the same facility or adjacent 

secured by a belt, harness or other attachment apparatus, facilities that are connected through the LAN or WAN to the 

flexible or not (in the embodiment depicted a strap or belt 5 remote wireless network. Alternatively, or as part of the 

104 which is worn around the user's 106 waist for securing same system, a connection 148 to an intranet, the intemet, 

the system imit or housing 102), to a user 106. The computer via modem or other such digital or analog communications 

102 further includes a monocular or duo-ocular display unit system may be used to remotely transmit a signal to a remote 

108 for receiving information from the computer 102. The location. 

display unit 108 displays information received for the com- piG. 2 shows a chart with the operational access that 

puter 102 under the control of user 106 or a remote operator. SIMON provides to the user of the SIMON portable com- 

The display unit 108 inay include a headband 110, a display ter and system. The SIMON engine, designated as 200 

f^'T ^ '^^""h n '.^'T^n connected i^es the user 202 access to a variety of ftinctionaHties. 

to the headband 110. The headband 110 is adapted to be ^he SIMON engine 220 is able to access one or more 

wom by the user 106 m any convenient location, but „„j„t ^ ■ 1 * -^41, m-i -^u • c 

preferably upon the user^s 106 forehead, as depicted. The 15 ^^^dules, n real-time, to provide the user 202 with infor- 

position of the display screen 112 may be adjusted via the '^t '^'' ^ ^toT""^ ""^^^^ T^"" application 204 and, e.g., 

adjustable arm 118 so that the operator may view comfort- ^ ^^^^ runnmg the mam program or any of the 

ably information displayed on the display screen 112. As ^^^^ modules that serve the user 202. For example, 

depicted, the adjustable arm 118, is in fact, not only an performing a specific task at a remote location may 

adjustable arm but a camera that displays to the user 106 20 ^^^^^ maintenance procedures module 206 to obtain 

through display screen 112 or to an operator at a remote ^^^P step instruction and maintenance procedures for 

location the image before the user 106. The display screen repairing a particular piece of equipment or for the use of 

112 is electrically connected to the computer 102, in the certain tools. The SIMON engine 200 also allows a user that 

present embodiment, via a cable 120, although other ways of is in the maintenance procedures module 206 to access 

connecting the two components may alternatively be 25 either the parts search module 210 or the parts locator 

employed. module 2 12, which permit the user to find out p arts numbers 

The computer 102 may further include transducers and and availability in the parts inventory, locally or globally, 

converters to provide communications with display unit 108 The SIMON engine 200 is also able to interface with a 

for receiving activating (from audio, eye-tracking or EEC) reports module 214 that is capable of taking the maintenance 

commands from the user, for converting the receiver com- 3^ procedure information derived from the maintenance pro- 

mands into electrical signals, for recognizing the converted cedure module 206 and submit a report, in real-time, on-Une 

electrical signals and for sending the recognized electrical or in a subsequent data dump. The report may be used not 

signals to a processor within the computer 102. In the only to report that the repair has been completed, but may 

present embodiment, the transducers and converters may also be capable of providing full parts listings for any new 

includes the microphone 116 through which the user 106 35 parts used or needed. By tying the reports module 214 into 

may issue verbal commands to the system, apparatus and a LAN or WAN, the report may be used to standardize 

method of the present invention. The microphone 116, the reporting and maintenance procedures without the vagaries 

speaker 114 and the display 118, in the present embodiment, and informality often found with hand-written maintenance 

are electrically-connected to the system unit 106 via a cable records. The reports module 212 itself, or a compatible 

120, although those with ordinary skill in the art will ^ apphcation, may also provide a docket of maintenance to be 

appreciate that any input or transducer device could be used conducted or that has been missed to update mamtenance 

and that the input or transducer could be supported by the records. 

user at some other location. jhe SIMON engine 200 is also capable of accessing 

The computer 102, m the present embodiment, may security protocols that permit it or limit the user's 202 access 

further include physical or non-physical connections to 45 to the SIMON engine 200 itself, for communications outside 

provide communication between the computer 102 and other of the SIMON engine 200, for access to information from 

peripherals 122 that communicate with the computer 102 the other modules, or any other security protocols that may 

and that may provide, for example, read-only or read-write be necessary. The SIMON engine 200 is also capable of 

memory or other capability (such hard disk, CD-ROM, improving its help to the user 202 through the learning 

DVD, Magneto-optical, or like storage devices). In the 50 module 218. The learning module 218 permits the SIMON 

embodiment depicted, the peripheral pack 122 is also engine 200 to increase user 202 performance by, e.g., 

attached to the belt 104 and is electrically connectable via noticing patterns in the user's 202 method of accessing the 

cables 126 to the computer 102. While the present invention SIMON engine 200 and its modules to anticipate the user's 

as niustrated in FIG. 1 is depicted using voice activation, it 202 needs. The diagnose module 220 allows the SIMON 

will be understood by those of skill in the art that other ways 55 engine 200 to provide troubleshooting information to the 

of connecting, accessing and controlling the computer 102 user 202 with real-time or on-line access to diagnostic 

may be substituted therefor as described herein. protocols, equipment or remote diagnosis capabilities. 

Also depicted in HG. 1, is a wireless remote communi- The communications module 222 allows the SIMON 

cations node 128 that serves to interconnect the user 106 engine 200 to interface with a variety of sources of 

with a remote wireless network 140. A wireless antenna or eo information, communications, data, and the like. For 

receiver 142 may be positioned in tiie same or an adjacent example, the communications module provides not only the 

room, depending on the range of the wireless remote com- voice-recognition capabilities to the SIMON engine 200, but 

munications node 128 and the reception and signal through- also allows communications within the equipment that 

put required for transmission of audio, video, computer data, serves, and is in contact with the SIMON engine 200 and tiie 

or any combinations thereof. 55 user 202. The communications module 222 is capable of 

The antenna 142 may connect through a local area net- accessing audio and video captured on any storage medium 

work (LAN) or a wide area network (WAN) through, e.g., a associated, or in communications with, the SIMON engine 
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200. The communications module 222 also permits the 
SIMON engine 200 to communicate by hard wire or wire- 
less with a LAN, WAN, intranet, internet or other network 
with which the SIMON engine 200 may need communica- 
tion. Data transfer through these local or remote networks 5 
may include, e.g., data, sound, voice, images, video or other 
analog or digital information that the user 202 may be able 
to access through the SIMON engine 200. 

More importantly, the SIMON engine 200 provides a 
"shell" program that is used to access machine, process or lo 
operation specific instructional programming, databases, 
troubleshooting, reporting and other information to a user 
performing a task at a remote location. The instructional task 
specific information may be stored at the remote location in 
the form of, e.g., CD-ROM or hard drive files that contain 15 
data, audio, image and video information that is specific to 
the task before the user. 

If a user must repair or maintain several different pieces 
of equipment in a given day, e.g., a single SIMON engine 
loaded on a portable computer is able to provide the user 
with task-specific information by loading the task-specific 
data. Once the task has been conducted, the task-specific 
data is removed or erased and new task-specific instructional 
data is accessed through the SIMON engine at a new 
location or for a different machine, process or operation. The ^ 
SIMON engine may be implemented in software, in hard- 
ware as a ROM or a combination of hardware and software. 

Main Application 

30 

The main appUcation module 204 of the SIMON engine 
may have, itself, a modular design and may be developed 
using Microsoft Visual Basic 6.0 or Microsoft Visual C++ 
6.0. The main application module 204 interfaces with a 
browser engine developed with, e.g., Microsoft \^ual C++ 
6.0. The main application module 204 enables the user to 
view pages written in, e.g., Hyper Text Markup Language 
(HTML) and interface with a machine's diagnostics file. 
Support for JavaScript and standard web related plug-ins 
(such as audio, video), may also be included as part of the ^ 
browser interface. 

Additional features may include voice activation using 
AT&T Watson Voice Control, or other voice control soft- 
ware and a Computer Aided Design (CAD) drawing viewer 
supported by the Autodesk Whip plug-in or other applica- 45 
tion. The application may be designed to run under 
Windows95/98, Macintosh or Windows NT operating sys- 
tem (OS). 

Voice activation aUows the user hands-free operation. All 
functions achieved via buttons or mouse events are capable 50 
of being achieved through voice commands. The Whip 
plug-in allows the user to view, e.g., CAD drawings in 
Drawing Web Format (DWF). The functions of zoom, pan, 
and scroll are controlled by Whip plug-in or other 
application, and may be voice- activated through voice con- 55 
trol software. 

The main application module 204 may have text -defined 
buttons across the top part of the screen that provides access 
to the other modules. Main buttons display a sub -button 
menu for additional options. A second set of buttons is 60 
displayed along the bottom of the screen that will show the 
general controls most needed for a specific function. Other 
buttons are displayed as necessary along the left side or 
bottom of the screen as required for each function. The main 
application module 204 may be designed to be the same for 65 
each customer or for each user. Some features and properties 
of the main application module 204, however, may be 
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deactivated at the customer's request prior to installation, 
and the customer may even control some features. Com- 
mands for voice activation may also be standardized, with 
additional commands customized to meet customer needs. 
The standard commands are single or two word "keywords" 
to insure consistency and connection accuracy. 

The response time using a keyboard, mouse, or voice 
activation to access the main application module 204 and the 
other modules will generally be less than 2 seconds. 
Requests for customized commands may be analyzed for 
complexity and structured to meet the response time criteria 
or an individual system or user. 

The main application module 204 of the SIMON engine 
functions as the main Graphical User Interface (GUI) from 
which all other modules are called. Since SIMON is prima- 
rily an HTML page viewer, it is visible at all times and will 
have a window area large enough to accommodate the 
HTML contents, but may be written in other like codes 
having Hke functionality. Each function of the main apph- 
cation module 204 is capable of user activation by means of 
a keyboard, mouse, or voice activation. Voice commands 
may match the button command or common commands 
identified in the command dictionary. Voice commanded 
words that are active within a specific HTML page are made 
known to the user through text variation of the voice active 
word. 

Tuming now to FIG. 3, the SIMON engine may auto- 
matically open when the user powers on the computer 
loaded with SIMON. If the SIMON engine is not part of the 
start-up of the computer when the computer was last 
shutdown, an icon is made available on the desktop that will 
aUow the user to use voice, mouse or keyboard to activate 
SIMON. SIMON opens with a login prompt 300 requesting 
the tiser to input their assigned ID and password. Such a 
login screen may or may not be required depending on 
system's security requirements as well as the presence or 
absence of the reports module. The user inputs their login 
information via a keyboard, voice activated or other input 
and SIMON determines is the user login is valid at 302. On 
confirmation, the user is directed to, e.g., a splash screen 304 
followed by a display startup screen 306. Tlie option to tour 
the functions of SIMON are selected at decision box 308, 
which permits the user to start SIMON 310 or enter a 
SIMON tour 312. 

If the login is invalid, an error message 314 is presented 
to the user and the user is allowed to try to re-enter the login 
name and password at decision box 316. If three failed 
attempts are made, then the user is forced to exit the 
apphcation at 318. Additional security may be added that 
requires administrator intervention to allow renewed access 
to the login prompt 300, if necessary. 

After confinmation and log-in, and following a brief 
change in screen appearance or splash screen 304, the user 
is given the option to tour 312 the functions of SIMON at the 
main screen display 320. If tour is chosen at 312, the user is 
presented with a training presentation on the basic operation 
of SIMON. The presentation will show the user the basic 
voice commands and how the various functions work. Upon 
completion, the user should have a good general understand- 
ing of how SIMON works and how to access its modules. 
The user is returned to the select option decision box 308, 
which permits the user to start SIMON 310 or exit the 
SIMON application 318. The decision for which module of 
SIMON the user selects is made at decision box 322, which 
permits the user to enter a number of SIMON functions, 
including, for example, the SIMON program setup 324, a 
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maintenance procedure thodule 326, a diagnosis module the operating system of the computer on which SIMON is 

328, a parts module 330, a reports module 332, a commu- operating to shut-down. 

nications or connection module 334 or a help module 336. All user inputs may be activated by, e.g., voice, keyboard, 

Similar modules are depicted in FIG. 2. or mouse. Input choice may be activated from a button 

Turning now to FIG. 4, in conjunction with FIG. 3, if the 5 menu. When a specific button from the button menu is 
set-up option is selected 324, the user is allowed to choose chosen, the button sub-buttons are displayed on the screen, 
from a number of options at 400. One option for the SIMON The following is a brief list of commands that may be 
engine is to permit the user to select from a number of automatically accessed by the SIMON engine by pressing a 
systems in need of maintenance to choose from. At system button on the screen or via single keyword, sound or visual 
select 402, the user is prompted to select from a list of cue from the SIMON engine by the user: 
available systems by displaying a list of machine types and File — File button, when activated displays "File" sub- 
machine model numbers that are available to the SIMON buttons on screen with the following options: 
engine. The user then selects from the list of machines Open — If "Open" is chosen, the user is given a choice of 
displayed 404. Alternatively, the user may be allowed to which HTML file to open. If only one HTML file is 
search by entering a machine to machine model from which available, that file is the default HTML file to open, 
to choose or that may be downloaded from a local or remote Find — "Find" will activate a pop up window allowing the 
site. Altcmatively, the administrator may deactivate this user to speak or type the word they wish to find. "Find" will 
feature if the SIMON engme is already machine, process or search the active HTML page for the requested word and if 
operation specific. Once the user selects from the list, ^^^^^ wiU highlight the word. The user is able to close 
SIMON will open the SIMON introductory page and load "Find" and continue in the active HTMLpage or elect to find 
the appropriate HTML page for that machine and model. the next instance of the word by using the "Find Next" 
The user may then choose to start the maintenance operation button. If no match of the word is found, the user will receive 
by indicating that they are familiar with SIMON and have ^ message box indicating "No match found", 
knowledge of how to work on that particular system in need Exit — ^If Exit" is chosen, the user is prompted to confirm 
of maintenance. Altcmatively, the user may access, through 25 ^^^^ ^i^h a Confirm Exit box. If the user chooses No, the 
SIMON, local or online reference material and are imme- Confirm Exit box will close and the user remains in the 
diately prompted with a selection criteria for use and opera- active HTML page. If the user chooses Yes, SIMON saves 
tion. Navigation may be through a keyboard, mouse or any updates to the appropriate report-log file and then exit 
preferably through voice or visual recognition commands. the active HTMLpage. SIMON wiU then return the user to 

The set-up option menu 324 in addition to allowing access 30 the Windows/NT OS desktop, 
to preselected options at 402, also permits the user to access Print — SIMON system may be attached to a printer if the 
specific files by accessing a drive and directory where user wishes to produce hard copy reports or even to "print" 
SIMON data files, such as HTML and database files are to a remote location electronically as a fax or data trans- 
located 408. The particular type of machine(s) or the mission. If the user selects print, a SIMON Print box will 
operation(s) that will be accessed through the SIMON 35 appear to identify the default printer and allow the user a 
engine may be selected from the menu or directory and print selection of reports or HTML page. The daily report 
access to the same may be restricted by the administrator log is highlighted as the default print selection. Date defaults 
depending on the user. The user may either select from a list to current system date for daily reports. If the user selects 
of file types or may search via name, number or other any other item, that item becomes the highlighted selection, 
identifier until a match is found. 40 The user may select an alternate date to generate a desired 

The set-up display menu 324 also permits the user to report. The HTMLpage selection refers to the active HTML 

access a customer support center (CSC) link 410, through P^g^- Choosing "Ok" will print the highlighted selection to 

which the user may have direct access to one or more CSC's. ^^e designated printer. Cancel will close print and SIMON 

Apreselected list may be made available to the user depend- will return to the active HTML page. Individual report 

ing on the machine and model selected at 402. The configu- 45 specifications identified under the Report Module, as 

ration options for the CSC may also be selected at 412, described in detail hereinbelow. 

which will conform to the CSC that is being accessed and Security — ^If "Security" is chosen, a security log-in win- 

the various options available to the user in terms of data, dow is presented. On verification of the users ID and 

audio and video access. The user may also select set-up password as administrator, the user is allowed to add users, 

options local to the portable system that the user is using. 50 modify existing users and delete existing users delete the 

One such option is the speech set-up 414, in which the user report log-files and deactivate the machine type entry box 

is permitted to change the user speech profile. This option is through the "Administration Edit" screen. The "Machine 

particularly useful when more that one user, or even a new Type Input Box" default is activated. If deactivate is chosen, 

user, may be using a portable SIMON system and the the button will change to "Activate Machine Type." 

computer needs to be instructed on the particular speech 55 Shutdown — If "Shutdown" is chosen, the user is 

pattern of the user. prompted to confirm shutdown with a "Confirm Shutdown" 

Likewise, the set-up display menu 324 may be used to box. If user chooses No, the "Confirm Shutdown" box will 

access the security set-up 418, which permits the user, close and the user will remain in the active HTML page. If 

depending on their level of user, to modify, e.g., user the user chooses Yes, SIMON will exit the active HTML 

accounts and privileges 420. The user is also allowed to 60 page then proceed to initiate the complete OS shutdown 

close 422, exit 426 or shut down 430 the system. The close sequence. "Shutdown" allows the user to turn the power off 

option 422 closes the main set-up window 424 and returns after shutdown complete, without having to initiate shut- 

the user to the start-up display screen 306 (see FIG. 3). The down through the Windows/NT OS. 

exit option 426, exits the SIMON application all together Diagnose — Diagnose allows the user to connect to the 

and returns the user to the desktop of the system. The 65 specified machine diagnostics file. Diagnose activates the 

shutdown option 430, on the other hand, exits both the Diagnostics Module as identified in the Diagnostics Module, 

SIMON engine or application and initiates or prompts for as described in detail hereinbelow. 
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Parts — Parts when activated displays Parts sub-buttons on its own unique identification name and wiQ follow the same 

screen. Parts provides access to the task specific parts series of commands as if selecting the default CSC. 

database and parts locator through the parts module. Help— Help when activated displays Help sub-buttons on 

Search — Search activates parts_search. Parts_search screen. The user can select Help Contents or About SIMON, 

allows the user to search a task specific database for a part ^ Help Contents— Help Contents opens a new window and 

by using a part number or part description. Parts_search is allows the user to choose the type of help wanted. The 

defined in the Parts Module specifications. choices for help under Help Contents arc SIMON 

Locator — ^Locator activates parts_locator. Parts_locator Commands, Parts Search, \^ewing DWF Drawings, About 

allows the user to display the customer defined, task specific Reports, About AudioMdeo and Dictionary. Each of these 

graphical view of the equipment parts. Parts_locator is ^'^ help topics will offer definitions or instructions depending 

defined in the Parts Locator Module specifications. on the title chosen. Help Contents is defined in Help Module. 

Reports — ^Reports when activated displays Reports sub- About SIMON — ^About SIMON opens a floating window, 

buttons on screen. Reports are defined in the Reports Mod- About SIMON contains the legal information, customer 

ule and are also task specific and may be customer defined. registration information, license information and plug-in 

Reports allow the user to choose the type of report to print. information that are required to use SIMON. About SIMON 

To insure security control of information, only the user with is defined in the Help Module. 

appropriate administrative rights is allowed to delete report- The SIMON engine may also have a failure contingencies 

log file information. an error message is displayed if data is not accessible. The 

Daily— The Daily report is the default report that is 20 ^ ^° connect to a CSC. The Main Application 

generated when the user logs on. This is the default report to program is written in Microsoft Visual Basic 6.0 and/or 

print when File_print is activated. Microsoft Visual C++ 6.0. Computer Security Requirements 

Custom— Custom reports will allow the user to generate include a security level set up in the security functions, 

a report by specifying the time interval desired. The Custom Human performance requirements, and/or reports thereof, 

report also aUows the user to create and filter a report by type 25 included for the purpose of monitoring user perfor- 

of maintenance (repair or preventive maintenance). a particular maintenance operation. 

Connect— Connect when activated displays Connect sub- ^ mentioned hereinabove, individual modules that are 

button on screen. Connect allows the user to establish a P^'* SIMON are used la conjunction with the HTML 

connection with a CSC computer. The connection allows full content and withm its context, that is depending on the 

duplex audio and live or still image video transmission, as 30 machme and model. TTie machme/model specific modules 

needed. °^^y contain program default information as well as cus- 

rQP If tK^,,o«ro«i«^*. r^c/^ CT^/^^KT n j * *u tomizcd information per customer request. For example, 

CbL — It the user selects CSC, SIMON will deactivate the •* *u * . r otkx>.xt 

„ J f H P ,u TTT^^TT 1- J delault mformation arc Hems that arc part of the SIMON 

voice command features of the HTML apphcation and i- *• u j j- i 

cTi^jnvr • t ^ - j . • T apphcation such as the command dictionary withm the help 

blMUN mteriace. Once voice commands are deactivated, ^ t t >*no rf ♦u • . r . 

oiunxr „, n * ur u j- / j n - 35 niodule 2 Uo. It the user requires assistance from a customer 

SIMON will establish an audio/video connection allowmg /'r^cr>\ fi, 1,1 * * j ^ u 

the ^er to have full duplex net conferencing type commu- f.T^^nH v h^' ^ 'f ? f " 

nications with the defa,Jt CSC. ""'^ ?! conferencmg via the 

communications module 222. Upon speaking the command 
Connection from a SIMON user performing a task to the for AA^ connection, SIMON will dial the customer service 
CSC may be provided by, e.g., connecting the SIMON user ^ center and activate the video camera for Hve feed. Corn- 
having a Wavelan® wireless transceiver to a server having mands (e.g., mute or pause) for the A/V wiU give the user 
a Wavepoint connection. The Wavepoint hardware and soft- some control over the functions of both the audio and video 
ware connect to a VBX telephone box- CODEC hybrid feed. 

connection. The VBX/CODEC transmits a SIMON inquiry ii'^r^r^r. «f • cix^rrvM -t 

*u u icM-^xr . .t_ ^T^^.^^Tx^^? . /r Upon completion of using SIMON, mformation pertam- 

through an ISDN connection to another XBC/CODECLAN : * *k w , ^ ^ ^ f . 

or.r,t.<^.f™ o* nc/- TT, i-cr- *i, 45 mg to the specific machine/model and repair parameters that 

connecuon at the CSC. The CSC can then receive transmit preselected or that are modified in the setup module may 

and display information from the SIMON user, be it data ^e automatically saved in, e.g., a report_Jog file for fiiture 

lint Tu " 7 7frrTf^' T'u "^^^ or report ou;puTfor use in the'reports module 

^TMOM ""'7 '^" n"?^ "^'^ ^ 214. Before completion of logK)fit the user is prompted to 

c>JM UN user has an inquiry about in real time. Of particular e *u * t • * ^ ^ r . 

. , ^ . . , A ixii^^. wi^aiiiL,mai vcr if y the type of maintenance or repair performed, if the 

importance is video transmission in color, where the color of ^^.^'l/™^*^* i.j j jj j.- 

i_ r 1 ■ . . ^ ' 7 . repair/maintenance task was completed, and add any addi- 

winng may be of critical importaiice to completmg the task, ^^^^^^ ^ repair/maintenance the user 

bu more miportantly, for the safety of the user m particu- add. A standard set of report options as well as 

larly dangerous situations. ^ customized reports may be provided for the specific 

The audio connection may be active at all times during the 55 task and may be reported as defined in the Report Module 

CSC connection. The video connection is at the control of 214, described hereinbelow. 

the user and activated as needed. If the video connection is user will have the choice of "Shutdown" or "Exit", 

activated, a small window will open on the user screen choosing "Shutdown" instructs SIMON to initiate a com- 

allowing the user to view the video feed to the CSC. When piete shut down of the system. Complete shutdown from 

the user has completed the communication with the CSC, a siMON will activate the Windows/NT OS shutdown 

salutation such as "hang-up", "disconnect" or "good-bye" sequence and allow the user to turn off the power when 

will tngger SIMON to disconnect and close the CSC con- prompted to do so. "Exit" closes SIMON and returns the 

nection. SIMON will verify that the connection is closed and user to the Windows/NT desktop allowing the user to initiate 

'^T^Znw^ ''''j'^ command features of the HTML file shut down when ready. The user may be required to enter the 

and SIMON mterface. ^5 machine type and machine number of the machine they are 

The customer will define the default CSC. If the customer working on (this feature can be deactivated by 

chooses to have additional CSC listings, each CSC wiU have administrator). 
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If shutdown is chosen then the entire SIMON engine activation. The maintenance procedure HTML displays may 

program may be shut down by connecting into the SIMON- display the procedure using graphics, text, audio or video, 

operating system automatic shutdown protocol prior to The information contained in the HTML is customer specific 

complete program shutdown. The user may also chose to data. The user can choose a "Show Me How** option to view 

exit the current customized machine or operation module 5 video (MPEG files) for tasks requiring supporting motion 

and return to the main SIMON screen. A default set of voice video. As with the previous module, and in fact all the 

command may also be activated through the use of a modules of the SIMON engine, these are voice, visually, 

keyboard or mouse. Additional commands may be added at keyboard or mouse activated. The user will select button 

customer request. Audio and video net conferencing, auto options to view the maintenance procedure data, as follows, 

dial capabilities may be provided when connection to a CSC lo The content is specific to the user's task and is displayed as 

is requested. A video stream feed allows a CSC the same follows. The user is able to view video clips by clicking or 

view as user, while a full duplex audio connection allows the speaking the "Show Me Ho V hyperlink. If multiple MPEG 

user to speak to the CSC direct. files are used, a different voice command is provided for 



each MPEG file. 

Help Module 



Maintenance Procedures Module -^^ 

Specific performance requirements for the maintenance 

module 206 may be provided using information displayed The help module shows the user a number of options that 

using HTML (HyperTcxt Markup Language). Button permit access to help information from a variety of sources 

options allow the user to move between procedures. The and at a variety of levels. For example, help button options 

maintenance procedm:es will allow the user to view online allow the user to select the type of help requested. Two 

procedures to repair, maintain, clean, etc. Video (MPEG — immediate options that may be made available to the user are 

Motion Picture Experts Group — files) are viewable from the "Help Contents" and "About SIMON". The help informa- 

maintenance procedures. The content is task specific, which tion may also be displayed using HTML. The help module 

may be selected in the set-up menu. allows the user to view on-line help information, for the 

FIG. 5 provides a flow chart of the maintenance procedure ^ various functions of SIMON as well as the legal require- 

module 326. For the maintenance or repair procedure data ments necessary for the ownership and use of SIMON. The 

and information to be accurate, the user may be prompted to HTML help pages will contain text and graphics, 

select the required machine, process or operation type and Specific performance requirements for the maintenance 

number; if one has not already been selected. Next, the user module 206 may be provided using information displayed 

is prompted to select a maintenance operation option at 500. using HTML (HyperText Markup Language). Button 

Two options that may be made available to the user are to options allow the user to move between procedures. The 

instruct SIMON to provide maintenance information related maintenance procedures will allow the user to view online 

to procedures that are either unscheduled 502 or preventive procedures to repair, maintain, clean, etc. Video (MPEG — 

504. Depending on the type of maintenance operation that is Motion Picture Experts Group — files) are viewable from the 

selected, the SIMON engine will display a browser window maintenance procedures. The content is task specific, which 

that permits for navigation of the appropriate HTML menu may be selected in the set-up menu, 

page 506. The browser window provides the user with FIG. 6 provides a flow chart of the help module 600. First, 

options to select at 508, which permit the user to access, for the user is prompted to select a help operation option at 602. 
example, hyperlink controls may also have standard and ^ Three options are made available to the user in help module 

customized browser controls for further navigation. The user 600 to instruct SIMON to provide help information related 

may even be provided with a list and schedule for each of the to the characteristics of the SIMON engine 604, such as the 

maintenance operations, whether preventive or scheduled. display of copyright and version information 606. Depend- 

If hyperlink 510 is chosen, then a context sensitive display ing on the type of engine and version, the SIMON engine 
512 is activated that provides the user with specific infor- 45 will display a browser window that contains the appropriate 

ma tion about the maintenance procedures. For example, information. The user may also select the Tour Simon 608 

MPEG video, Autocad drawings, viewer and schematics, option, that directs the user into a multimedia presentation 

etc., are displayed for the user. Alternatively, the user may 610 that contains information about the SIMON engine, its 

select to enter a browser control 514 window though which uses, etc. Alternatively, the user may select the contents 612 

the user select may elect to operate the functions of the menu that directs the user to a browser window that provides 

browser, such as home, refresh, back, print, find, etc., that the user with options 616 to select at 614, which permit the 

are enabled through the HTML menu page 506. user to access, for example, hyperlink controls 618 may also 

One of the options provided at the maintenance procedure have standard and customized browser controls for further 

options prompt is the display of the graphics, text and any navigation 622. 

hnks that are provided for that particular option. An option 55 If hyperhnk 618 is chosen, then a context sensitive display 

display may, for example, include a hnk to the context 620 is activated that provides the user with specific infor- 

sensitive display At the option display the user is aUowed to mation about the content of help available. For example, 

access information that is selected by paging down or up MPEG video, Autocad drawings, viewer and schematics, 

through the HTML page for the maintenance procedure(s). etc. are displayed for the user. Alternatively, the user may 
Alternatively, and if available, the user may be prompted to 50 select to enter a browser control 622 window though which 

display a sound or video chp, or may simply return to the top the user select may elect to operate the functions of the 

of the page TTie user may be provided with the source data browser, such as home, refresh, back, print, find, etc. that are 

and/or reference equipment or permitted to input context enabled through the HTML menu page 624. 

specific information at the administration level, if appropri- The help module 600 may have the same help information 

65 for all customers for a particular machine, process or 

HTML files will lead the user through the maintenance operation, however, other more user or task specific options 

procedures, by hyperlinking with point and click or voice may be made available to specific users whether by limiting 
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access to the iafonnation or by Dot providing information 
that may be outside the expertise of the specific user. 

The help module may be written with Microsoft Visual 
Basic 6.0. Pages for Help may be written in HTML. "About 
SIMON'* information may be written in a Visual Basic 6.0 5 
window. 

The contents of the help function for use with the SIMON 
engine may include topic selections that provide a list of 
"Help Contents", which the user may access through a 
selection of preselected help topics. The "Help Contents" 
portion of the topic selection index is a list of available help 
topics from which to choose. Selection of a topic display 
help information about a specific topic may also be reached 
by searching using letters, keywords or phrases as part of tbe 
search topic profile of the help menu. If the searched for ^5 
topic is found within the selected help contents menu, then 
the SIMON engine takes the user to the specific location of 
the search information sought, or the user may be prompted 
to another selection after reviewing the material presented. 
Alternatively, the user may not find a topic and an error 20 
message is displayed and the user is prompted to try again. 
At any point, the user is permitted to chose the close help 
option that returns the user to the main SIMON engine 
window. 

The default Help HTML page that contains the selected 25 
topics and may be created using Microsoft Visual Basic 6.0. 
Voice, keyboard or mouse activates all user inputs. When 
user selects the Help button, the Help sub -buttons are 
displayed. The user will have the choice of selecting "Help 
Contents" or "About SIMON". 30 

Help Contents — Help Contents displays a list of available 
help topics. The Help Contents HTML page displays a list 
of available topics. Topics will include SIMON Commands, 
Online Reference Parts Information, Viewing DWF 
Drawings, About Reports, and About AudioA'ideo. Each 35 
topic will fink to its specific HTML page and further expand 
on the help information available to that topic. 

About SIMON— About SIMON opens a floating window. 
About SIMON will contain the legal information, customer 
registration information, license information and plug-in 40 
information that are required to use SIMON. If the Help 
Content HTML page fails to load, an error message will 
appear. The user will have the option to try again or leave the 
Help Content. 

An error message is displayed if the HTML page fails to 45 
load. The user is given the choice quit or try again. If it fails 
a second time, the user is instructed on how to check for the 
HTML help page and how to reload the page if necessary. 
Content for Help may be written in HTML and the display 
configuration will depend on the system, operator, machine 50 
or operafion to be undertaken. 

The Help module may or may not include any functions 
that may be changed by the user. The security may be 
defined at the programming level or by limiting or not 
providing the user access to help data beyond the preselected 
criteria of the SIMON engine that was customized for that 
particular use. The help module may even provide a dictio- 
nary of components and provide the user with alternative 
references for a like item in a task specific manner or 
context. Likewise, the help module may provide the user 
with help as to the use of SIMON, its command structure and 
capabihties. The help module may even be used to obtain 
step by step instruction for communication with a CSC. 

Parts Search Module 

65 

The parts search module provides the user with informa- 
tion that is read from a parts database, whether local to the 
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computer or fixed storage medium or available through the 
communications module. The parts database can be in 
Microsoft Access or Oracle. Search request information is 
input from the user. A database search will occur and records 
are read and displayed. The matching records are displayed, 
for example, up to 20 at a time. Error messages are displayed 
if a database error occurs, the data is not in the expected 
format, or if no data is entered. If no data is found a message 
is displayed to that effect. 

The parts locator or data module is now described in 
connection with FIG. 7. The display parts menu 700 may be 
a custom format for each task that a user needs to perform. 
The program determines the database format, e.g., Microsoft 
Access or Oracle. The program will read the header infor- 
mation to determine the fields and field lengths. The search 
will not be performed if the program cannot open the 
database, the database is not readable or is not in the correct 
format. 

The parts program may be called display parts 700 and is 
accessed through a display entry screen 700 in which the 
user is prompted to selection 702 from a two options: locate 
parts 704 or search parts 706. If the user selects the locate 
parts 704 option, then the user may select the contents from 
a menu in a browser window 708 that provides the user with 
options 710. The options 710 available to the user may 
include hyperiink controls 712 or customizable browser 
controls 716. 

If hyperhnk 712 is chosen, then a context sensitive display 
714 is activated that provides the user with specific infor- 
mation about the parts available. For example, MPEG video, 
AutoCAD drawings, viewer and schematics, etc., are dis- 
played for the user. Alternatively, the user may select to enter 
a browser control 716 window though which the user select 
may elect to operate the functions of the browser, such as 
home, refresh, back, print, find, etc., that are enabled through 
the HTML menu page 718 

Alternatively, the user is prompted to search the parts 
database 706 or submits user provided data to be searched at 
a display entry screen 720. The user may then make a 
selection from the criteria provided by the user or made 
available to the user at retrieve search criteria 722. The user 
may then select from three options at 724. If the user decides 
to submit the criteria input or selected by the user 726, the 
criteria is directed to a query database 728 for an exact, 
partial or related search parameters. If the user makes an 
error in input the user may cancel the search at 740 which 
leads the user to the main menu at 742. Alternatively, if the 
user makes an error the fields may be reset and a set search 
blank criteria is presented to the user at 746. Reset clears any 
and all search fields 722 input by the user, thereby resetting 
the search parameters. If no data is entered an error is 
displayed, which then prompts the user to once again input 
user data. 

If the user provides input data, such as part name, number, 
catalog number and the like, the parts program searches the 
database for the corresponding part. The search results are 
then displayed 730. If no records match a message is 
displayed that no records were found using the user input 
search parameters and the user is provided with an options 
menu 732, from which the user may select a new search 734, 
the next 20 search hits 736 or to end the search 738. The next 
20 hits are provided at 742; if 20 or a fractions thereof 
remains. If the user selects to end the search, then the user 
is returned to the main screen 742, wherein the user is 
allowed to choose from the main menu options. 

The user may input a data request directly or select from 
a "call-out" number that is linked to an image of the 
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machine, process or operation that a user is performing and The remote on-lme data are stored in either Microsoft 

that the user accessed through the SIMON engine. The Access or Oracle. The program determines the database 

program will get the data entered and send a message that format, Microsoft Access or Oracle and communicates it to 

contains the user input to parts__search to start the database the user over, e.g., a wireless network. The program will 

search. If the search yields a match or several matches then 5 read the header information to determine the fields and field 

the program displays a screen to the user with the first 20 lengths. In case of an error message, the display error 

data search output matches. message is displayed if the data from the database is not 

If the user asks for more data a message is sent to accessible or beyond the user's access level. The user is able 

parts_search. Parts__search will send more data and it is to conaect to a CSC to obtain access or the informatioo 

displayed. If the user is finished, a message is sent to lO directly. 

par ts_se arch and the program ends. This option allows the A graphic part locator is selectable from the parts menu, 

user to look at however many screens are part of the parts The content may be customer, machine or operation specific, 

search information for that particular part. The graphic file format may be, e.g., .dwf (drawing web 

A number of functions may be provided that form part of files), .bmp (bit map), .pcx (PC Paintbrush), .gif (graphics 

the parts search module, so begin_search — opens the 15 interchange format) or jpeg (joint photographic experts 

database, call search_records. When finished is received group). The source data for a particular machine may be 

from display_parts, the database is closed. If the open is not provided by the customer or may be developed apart or in 

successful, an error message is sent to display_parts. conjunction with the end user or machine manufacturer. The 

search„records— finds the first 20 records that match the parts locator module 212 may be written in HTML. The 

data received and send them to display_parts. If no records Whip plug-in or other application is used to view files in 

are found a message is sent to display_parts indicating no dwf format. 

records were found. While the user wants more records the The parts locator module serves to display machine parts 

next 20 are sent to display__parts. If the read is unsuccessful, or operational steps with "call-out" numbers that allow the 

an error message is sent to display_parts. user to look at the next level of parts break down. For 

display_screen — displays the screen for user input; ^ example, once one part containing a number of sub-parts is 

user_response — receives user input, formats data and identified then the user may call out the number or numbers 

sends to parts_search. of the sub-parts to observe, e.g., their interaction within the 

display_data— receives data from parts search and dis- ^^^SP^ °^ P^^ts. This parts breakdown display provides 

plays the results. This function displays messages to the user ^^^^ blow-ups and assembly information for the 

When the parts search module receives data from part(s) as well as "call-out" numbers for the parts. The part 

display__parts, it will open the database, read data and look ^fonnaUon from the database may be displayed, e.g., at the 

for a match. It will send, e.g., the first ten items found to °^ ^^P^^^ ordering purposes. The part 

display_parts and wait for a message from display_parts. If n^ber may be looked up directly and ordered or located, 

the user asks for the next records, the program will look for ,5 Alternatively, the user may chose to back-up and display the 

the next 20 records and send them to display _parts if found. Pi^vious part break down at a higher level. 

If records are not found a message is sent to display_parts. Th^ HTML page displays graphics of the machine and 

If the user is finished, the program wUl close the database. P^r^s. The user is able to view breakdowns of the parts by 

The database format for use with the parts search module choosing call-out numbers defined on the graphic and may 

may be task specific. As with all the other modules, the user 40 ^^^"^ their interaction or assembly video using instruc- 

input may be voice, keyboard or mouse. Information is read MPEG video or other images, 

from a parts database that may be in Microsoft Access or The HTMLpage will call a Visual Basic program, passing 

Oracle formats. Information is input from the user directly it the part information to locate in the parts database. The 

orby selecting "call-out" numbers associated with an image. P^rt data is located in the database and displayed on the 

In operation, after choosing search, the user will enter 45 ^he user may input by voice, keyboard or mouse, 

data to search for in the database. The user may submit the ^he user will select Parts fi:om the button menu. The parts 

data, reset the entry fields or cancel the search. The entry sub-buttons will appear as follows. 

screen will appear A database search will occur and records The voice input may be the user choices, such as, call-out 

are read and displayed. The search will look at aU fields in numbers. The call-out numbers are displayed at the next 

the database to make a match. If a match occurs, the first 20 50 level for a parts break down. Back displays the previous part 

records are displayed with menu options that allows the user break down. Help is available from the parts locator module, 

to look at the next 20 records, perform a new search, or end Alternatively, the user may chose to exit the parts locator 

the search. If the next option is selected, 20 more records are module and close the part breakdown information, 

displayed. The user is able to select a previous option to look The image graphics file can be dwf, bmp, pcx gif or jpeg. 

at the previous 20 records. If there are no previous or next 55 The data is stored in either Microsoft Access or Oracle. The 

records, the previous or next option will not be selectable. program determines the database format, Microsoft Access 

The search results screen will appear as follows. or Oracle. The program will read the header information to 

Finally, again with reference to FIG. 7, if a database error determine the fields and field lengths. The matching record 

occurs an error message is displayed. This message is is displayed. 

displayed if the program is unable to open or read the 60 A message is displayed in the bottom frame if the data 

database. If the data is not in the expected format, it is fi^om the database is not accessible. The parts locator dis- 

unreadable data. If the user has the ability to connect to the plays a graphical parts locator of the machine and part 

customer support center (CSC), there is an option to connect information. The parts locator module program may be 

to the CSC to obtain the access to the local database or even written in HTML and may contain a top down break down 

access a database on-line. If no database is accessible an 65 section that has one or more security levels set up in 

error message is displayed prompting the user to contact the conjunction with or independent of the security module 

CSC. functions. 
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Reports Module print out another report or a copy of the present report at 908 . 

The primary duty of the reports module is to generate following are the detailed functional and performance 

hands-off report logs that reflects the task-specific preven- requirements for a reports module. 

live and repair maintenance of SIMON users. The module DAILY— allows the user to print the production day's 
also captures a database log of visited screen titles. Report ^ r^pori log. This function is strictly limited to the current 

data may be gathered on the initial activation of SIMON and day's log activities. Requirements other than the daily 

stored in, e.g., Microsoft Access database format. The date activity should be referred to the submenu function "Cus- 

and time of the report capture will equal the system's date tom." Selection of "Daily" option will default with the 

and time at log-on and indicated accordingly on the report. current date. 

Failed performances are also captured and recorded. The CUSTOM — allows the user to directly specify the exact 

report module may operate independent of the user in date of desired activity. Users may enter a beginning time 

addition to being transparent to the user. Else, the user may period and an ending time period to print the log report. For 

activate and inactivate the reporting function depending on a printing of the current day's log, the "Daily" option is 

their access level. used. 

Users have the option to generate a daily or custom report HTML Page: allows the user to print-out the active HTML 

from the Report button sub-buttons. The daily reporting page as displayed on the SIMON screen, 

option prints a daily log of all activities related to preventive The data obtained from the user during a specific fast and 

and repair maintenance specific to that day. The custom maintenance or repair of, the machme, process or operation 

reportmg option in the report submenu allows the user to that is needed may be provided via inputs generated based 

enter the desued time period to print the report. This means on i^g capture activity or via user input. This is directly 

that the user is required to specify the beginning and ending proportional to the user's frequency of usage. Outputs may 

periods needed for "printing" under the custom option. The be generated with hardcopy reports. In case of failure, the 

Custom option also allows a filtering option that enables a reports menu or failed access to the printing of the report 
selecuon of preventive mamtenance only, repair mainle- ^ Uems may be solved locally or via contact with a customer 

nance only, or both. Printing includes both hard copy and support center 

electronic data reporting functions. * . - i * j .nn>i .i. 

„ i. . t 1 1 . t lithe custom option is selected at 904, then the user eaters 

The accuracy of transmitted data and requirements data beginning and ending period for the custom report 910. 

are based on report data generated by the system for, e.g the Alternatively, the user may be prompted to request different 
Microsoft Access database and may be task-specific Valid- 3^ forms or types of reporting, e.g., a more condensed report for 

ity of the data is determmed from the recording of informa- transmission via wireless LAN. The report log print-outs are 

Uon within the system report log. customized according to the customer's desired output 912. 

Response time for screen title log capture is less than one Modifications are to be managed by the customer for any 

second. Response time for pnnting the Report module will subsequent changes to the report format, 
vary dependmg on the type of printer models used or 35 Because of the importance of maintaining, fiUng, keeping 

™un:cationslinkprovid^^ time is also depen- in some cases maintaining security, a mandatory secu 

dent on the frequency of SIMON activity that is captured in 1 • 01 ^ • * u ^ 

1 11 .t- 1 .1. r ^ -r . ^ly logui S'l^ requirement may be necessary for access to 

report logs, as well as the length of the report or if a number {t„ u t ^ a ■^ i ^ *u 

f * L • u J ^ X- PiiDt log reports whether from daily reports or n:om the 

ot reports arc being submitted at one tune. , u r _^ j . ^ ^w.l 

o • « . /- . . . . . custom reports subroutine of the reports module 214. With- 

u c?x.1m ^ x^n u ^^P^rt^g °f ^ out login authority, the reports submenu option is unavail- 

the SIMON engine. A Reports button is available from the ^ble and disabled 
button menu at the main SIMON engine screen (as are the 

other modules disclosed herein) and provides access to the Security Module 
reports menu options 900. Selection of the sub-button 

options under Reports via voice or mouse method initiates 45 The component module of the SIMON engine that main- 

the opening of specific or generic electronic reports. There ^^i^^s security to and from the program is the security module 

are two selections from which to choose — Daily 902 and 216. The security module is described m conjunction with 

Custom 904. Selection of the Daily option 902 prints a is a flow chart of the security protocols. The 

reportof, e.g., the daily log record. The daily log report may primary duties of the security module are to safeguard 
be a prompt for the user to conduct that maintenance or 50 software integrity and provide maintenance accountability 

repairs on that day, or may serve to report the users main- The mode of security performance is defined as follows, 

tenance and repair of the day that passed. Selection of the ^'^^y '^^ SIMON engine is started 1000 the user is 

Custom option prints a report specific to the user's begin- prompted to log-in 1002 using their user identification 

ning and ending date. The printed report, or an electronic number and if required a password. The process may involve 
version of the report, may be submitted with the communi- 55 ^^o steps, first the user number is requested and then the user 

cations module for viewing by the user, to network, to one password 1004. If the login and password are correct then 

or more serves, to the customer support center or to any "ser is allowed to access the SIMON system 1006. 

other software package or user that is in need of the report. When the security module is a mandatory requirement it 

For example, the finished report may be sent to a remote allows users to enter a login and personal password to verify 

location for gathering, analyzing, storing and acting upon eo authenticate access. All users must gain access through 

the reported data. a vahd usemame and password. An allowance of three 

Selecting to print 906 a pardcular report invokes the attempts, e.g., may be provided, 

above selection box. A printer must be attached if a hard Part of the SIMON system permits the user to enter the 

copy printout is desired. If only a single printer is available, administration option 1006 within, e.g., the file menu or a 
that printer is displayed in the printer text box. If there are 65 separate menu. The admmistration option 1006 requires that 

multiple printers available, the user will have a box from the user provide an administration login 1008, having the 

which to choose the desired printer. The user may wish to same or more stringent security requirements than the login 
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user identification 1002 and password 1004 necessary to access or above to restore. Other failures will require coor- 

access the main SIMON engine program. dination with the customer support center for support. 

If a user enters an incorrect login and/or administration Dependent upon the level of desired security, encryption 

password on the initial attempt, the program may allow the modes between 128 and 256 bit is used to insure stable 
user two additional attempts before returning the user to the 5 system integrity. 

SIMON engine. If a correct login and password is verified For high level security tasks, it may be mandatory that 

and authenticated, system access into SIMON administra- system developers and users assign the initial assignment of 

tion is granted. If the user wishes to make changes 1016, level logins and passwords. Administrators may change this 

and/or updates 1018 and/or delete 1020 users and passwords using high security access codes. Security level access may 

for authorized users as well as activate/deactivate the lo be partitioned into, e.g., four domains: 

Machine type input box 1012 or delete a user/log-file 1018, i Administrator domain-highest authorization access: 

the user inust provide avalid ID-password. A valid has access rights in all domains; no restrictions are 

ID-password allows the user access to the Administration pieced on the Administrator security level. 

Edit screen 1010. Users are able to access options of ^ . , . . . • . ,i 

SIMON^s interface menu system. Access into the software's 15 ^ Manager domam-has access nghts to all areas except 

configuration, however, is disallowed. Only developers with "^'^^^ ^^'^ "^"^"^^ ^'^'^ ^'^'^ 

a developer's password are allowed to configure system 3 Supervisor domam—has access nghts to most areas; the 

functions. Developers are able to customize configuration Manager and/or Administrator wiU define theunautho- 

features accordingly, for example, an administrator may ^^'^ ^^^^ access. 

reach the set administration 1014 screen in which adminis- 20 4 User domain — has hmited authorized access; the Super- 

tration access may be completely forbidden, especially from visor and/or Manager win define areas of access, 

users. Referring once more to FIG. 9. If a user enters an 

For high level security requirements encryption of pass- incorrect login and/or administration password on the initial 

wordsandloginnumbersmaybeused. Higher security may attempt, the program will allow the user two additional 
be achieved using single-key usage coding and encryption. ^ attempts before disabling system access 1022. If a correct 

Accuracy of transmitted data and requirements data are and password is verified and authenticated, system 

based on data for a specific task or provided by a user. access into SIMON is granted. Valid ID-password will allow 

Validity of data may be determined by the comparison theuser access to the Administration Edit screen 1024. Users 

between given data and the software's embedded data. The ^^^^ access options of SIMON' s interface menu 

following are specific examples of commands and their system. Access into the software's configuration, however, 

functionality as it relates to the security module, ^ disallowed. 

<USER>-»Login Usage_Login with a password is a Communication Module 
mandatory requirement to access SIMON' s software sys- 
tem. Access is restricted to non-authorized users. Attempted Local. SIMON may be fully voice -activated, that is, 
log-ons are limited to three tries before system lockout functioning primarily on voice commands. A manual key- 
occurs, A manager's level access is required to restore bo^rd or even visual tracking interface is optional as the 
system functionality in the event of system lockout. Levels ^P^f output device used by the SIMON user to com- 
of authorized access are assigned according to user's access municate and provide commands to the computer. Likewise, 
needs. There are limitations of user's navigation area within input/output capability may be used to access the 
the software (i.e. no access in the configuration ^ communications capabilities of the SIMON engine with 
environment). Based on predetermined design specification, ^^^^1 ^^^s and a local network. Voice operation enables 
the user is restricted to modules defined by the developer. ^&cts to navigate SIMON's GUI interface hands-free. 

<DEVELOPER>— A developer's password enables the Reserved words may be saved for specific SIMON 

developer to access SIMON's configuration to add/update/ commands, e.g., open, close, print, send and exit. Input/ 

change/delete any aspect of the coded modules, thereby output devices for the construction of a "portable computer", 

allowing the developer to customize SIMON's configura- ^ ^ computer sufficiently lightweight and designed to be 

tions accordingly ^ ^^'*' e.g., the MENTIS computer 

LOGIN-aUow users to enter a personal identifier for anteractive Solutions, Inc.) weighing about 2 to 5 pounds 

individual authorized access. Log-ins require alphanmneric (exclusive of the battery pack) and is five and a half by seven 

entries with a minimum of, e.g., five and a maximum of ten half inches m size. The computer may have a 266 MHz 

characters. Alphanumeric entries may or may not be case P'^^^™ r^'^uT? megabytes of RAM and a four, 

sensitive ^^^^^ gigabyte hard dnve. The computer may also be 

PAccwnon .11™. i i 1 A f connected to a portable CD-ROM, ZIP, DVD or like large 

rASSWORD — allows user to enter a personal code for i * j- t^. . - , .f 

M 1 *u • J Ti J • 1 7^ scale storage media. Through a wireless connection, the 

mdividual authonzed access. Passwords require alohanu- « i i . j 

, . . . r T '^^^'^''^ aiyiiauu 55 g^^j^ storagc mcdium may even be at a remote 

menc entries with a minimum of, e.g., five and a maxunum i ^- r^.u u a 4u* - . ^ j i^^uiui^ 

of ten characters location. Other hardware that may be mterfaced with the 

PAccwnDnwoDFTTinATnr^M 11 . j . portable computer via SIMON includes but is not limited to: 

PASSWORD VERIFICATION — allows user to update or i\ t/vi n c r^^^-v im 

u . I--. 1. 1) VideoCam: Sony CVX-Vl 

change personal code. The system administrator determmes ^\ ^ , 

the frequency of password changes. so ^^^"^ ^""^^^^ hni\X-in earpiece 

Thcspecificsecurity features for use with a particular user ^) ^^^^ ^ '"^ ^^'"^ P^°el display 

of the SIMON engine may be configured to customer's ^) external audio speakers 

specifications. Only inputs of login and password data are 5) on headphone/microphone set: LabTec Clearvoice^** 

entered using, e.g., voice or keyboard input. AJso, login and 6) LAN hardware: WaveLAN®, VBX/CODEC 
password data may be stored for purposes of authorization 65 Accuracy of transmitted data and requirements data are 

and authentication. In case of a system or software failure, based on equipment installed per each component of the 

access to the SIMON system will require a manager's level communications hardware. The accuracy of transmitted data 
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may be checked using systems and software known to those Once a connection with a CSC 1100 is estabhshed, the user 

of skill in the art of data verification. can determine whether or not they want to include video 

The voice recognition software used by the communica- imaging capability over the wireless I-AN, WAN or Internet, 

tion module may be any suitable VR system, preferably the or wirelessly to one or more antennas which send the signal 

AT&T Watson Voice Control communications software des- 5 to a VBX/CODEC system for transmission over ISDN lines, 

ignated for SIMON. The AT&T Watson Voice Control If a visual connection is required, e.g., when the operator at 

software application may be embedded within SIMON the CSC must also be able to see the operation of the 

allowing users to speak commands through a microphone machine and the operators predicament, then the video 

via headphones or one attached to SIMON's unit. camera is connected 1102, else the video camera is discon- 

Altematively, Dragon Software's NaturallySpeaking® may lO nected 1104. Likewise, the connections to a LAN can be 

be used and has the advantage of accepting natural language made 1106 or disconnected 1108, a modem connected 1110 

commands, which allow users to edit and format documents or disconnected 1112 and audio may be connected 1114 or 

by speaking commands in a more natural way. It also has an disconnected 1116. Commimications with a CSC provide the 

enlarged active vocabulary, and Dragon NaturallyMobile™ user of SIMON and the SIMON engine to access in real-time 

software, which makes it easy to create documents using a 15 a broader and often more experienced workforce that can 

hand-held microphone that can also be used to record any help the user repair a particular machine, 

communications. SIMON is particularly useful when a user at a remote 

The Dragon NaturaliySpeaking® software application, location is presented with a task when dealing with wires or 
for example, enables users to navigate SIMON's menu and equipment that is color coded. The use of a color video 
sub-menu options with reserved spoken words. Non- 20 camera with sufficient resolution and transmission rate will 
keyboard interaction may be required which will permit the be required to provide the CSC with valuable, and perhaps 
user to engage in other tasks as well as offering mobility critical information. The use of a color camera will be 
within the work environment. The types and specifics of a particularly important to reduce the risk of injury to main- 
user's voice may be stored and accessed from reserved tenance and repair personnel that may not be aware of the 
vocabulary commands that are pre-input into the commu- 25 operational dangers of a particular piece of equipment or 
nications module. Voice recognition may even be imple- process when communicating with a CSC in real time, 
mented as a digital signal processor. 

Remote. Any communication to a CSC is accessed via Diagnose Module 

SIMON. Likewise, peer to peer communications may be The diagnosis module provides the SIMON engine spe- 

accessed through SIMON to provide communication over a 30 cific information and routines, protocols or checklists that 

wireless LANAVAN between SIMON users. One such con- in machine diagnostics. The diagnostic module of the 

nection may be through a WaveLAN® card using the SIMON engine is described herein in connection with FIG. 

NetMeeting software. 11- TTie machine diagnostics process begins with an error 

The following is a list of functionaUties and equipment for code or codes being produced by the machine, operation or 

use with the present invention. 35 process that is in need or repair or maintenance at 1200. This 

MdeoCam — This unit allows parties other than the user to error may be provided for in software in the resident 

visually see the same screen information as the user, for machine and input directly into Simon by the user, 

example, a Sony CVX-11. Alternatively, the error code entry screen 1202 is chosen 

Audio — ^This unit will allow the user to hear speech froni which the user may view and retrieve error codes 1204 

and/or sound and interact with the SIMON system via voice 40 from a Hst or lists or codes. The list may be arranged in a 

activation. number of configurations, such as alphabetical, numerical, 

LAN — This connection will allow the SIMON user to t»y machine operation or part grouping, etc. To evaluate and 

connect remotely to a LAN for network interface. determine what problems may be occurring on the machine 

Modem — ^This unit enables the user to auto dial an IP user then accesses a database to get to the matching, 

address to the CSC or other phone Hsts. 45 appropriate or related HTML links 1206 that are specific or 

In the event that SIMON'S voice recognition functionality related to the error codes. Next, a dynamic HTML menu 

is disabled, the unit may be automatically connected with page is written to disk 1208 and the user reaches a browser 

CSC to allow troubleshooting. If further connection fails a window 1210 that provides the user with options 1212, 

manual caU in to a CSC may be required to diagnose the which penmit the user to access, for example, hyperUnk 

problem. If it is a minor hardware failure, a camera con- 50 controls 1214 may also have standard and customized 

nection witii a CSC representative may be used to diagnose browser controls for further navigation 1218. 

the problem via video. Video or audio access will afford a If hyperlink 1214 is chosen, then a context sensitive 

solution (i.e., replacement of part) on the faOed hardware display 1216 is activated that provides the user with specific 

component. If it is a software failure, remote connection via information about the content of help available. For 

LAN will allow a CSC representative to upload software 55 example, MPEG video, AutoCAD drawings, viewer and 

directly or allow the user access to that funaionality. As a schematics, etc. are displayed for the user. Alternatively, the 

last resort the user may have to reinstall the software. user may select to enter a browser control 1218 window 

While it may be readily apparent, it is not always easy to though which the user select may elect to operate the 

interface individual hardware components to be compatible . functions of the browser, such as home, refresh, back, print, 

with individual communications components. This is a prob- 60 find, etc. that are enabled through the HTML menu page 

lem especially when using equipment from different ven- 1220. 

dors. The present inventors have overcome that problem by Based on an analysis of the operational situation of a 

using a central program to interface all the hardware com- particular user and machine, process or operation is deter- 

ponents. mined. The diagnosis module wiU have access to machine. 

In operation, the communication module is described in 65 process or operation specific information that is part of the 

connection with FIG. 10, in particular with a connection task specific database that the SIMON engine is able to 

with, e.g., a network, server, or other SIMON users a CSC. access. 
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The diagnostics module may merely function as a trouble- 
shooting guide, but in particular cases and instances may be 
designed to be a fully integrated, multi-functional, miilti- 
media system that guides the user through the diagnostic 
procedures of a particular piece of equipment, operation or 
process. 

For example, a menu of common problems encountered 
with a particular operation may be displayed as a selectable 
menu. If no common problems are found, a common prob- 
lem list (which may be searchable) is displayed and the user 
is prompted to select an option. Alternatively, the user may 
access a help menu 1210 either from the common problems 
list or from a more generic problems hst. If a particular 
problem is selected by the user, then the maintenance 
procedure for that equipment, machine, operation or precess 
is displayed. Different levels of explanation may be 
presented, depending on the complexity of the task or the 
user's need for instructional help. 

The user will be provided with a task specific diagnostics 
file and file format, e.g., the common problem list. The 
diagnostics module may be written in Microsoft C++ ver- 
sion 6.0, The diagnostics module will generally be task 
specific. For example, the customer may also provide the 
machine diagnostics file and information on interpreting the 
file. The customer provides a common problem list, which 
might include nondiagnosable problems. 

The diagnostic module wiU read the reported error data 
provided by the system or the user and determine what 
problems are being reported or observed on the machine, 
process or operation. A problem menu is displayed with the 
results. If no problems are reported, a common problem list 
is displayed from which the user may select maintenance or 
repair information. 

One example of a diagnostics program is called KBS 
(Knowledge Based System). When the diagnostics program 
is called, the machine diagnostics file is read and analyzed. 
The KBS will read a table to match the analyzed data to a 
problem description and HTML (HyperText Markup 
Language) file name. As with all the other modules disclosed 
herein, the diagnostics module may be implemented in 
software or hardware. 

The following are a number of specific commands that 
may be tised with the diagnostic module. 

Diagnose — opens and reads the machine diagnostics file. 
The data is analyzed, depending on the customers or task file 
specifications. Problem numbers are sent to get__problems. 
If no problem numbers are found, a common problem list is 
displayed. 

Get__problems — opens a kbs.tbl file and matches the 
problem numbers received to a problem description and a 
html file name. This information is sent to the calling html 
page so that it can display the problems and associate an 
html page to each problem number. 

Learning Module 

The learning module may be customer, machine, 
operation, equipment, or process specific. The learning 
module may be developed using, e.g., Macromedia Author- 
ware. While the customer may provide the source data for 
the learning module, custom learning systems may be devel- 
oped to service particular system needs. 

An interactive learning application may be developed, in 
Macromedia Authorware for customers choosing this mod- 
ule. The learning module may be an interactive training 
application and can include animation, sound, hot spots, 3D 
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graphics, simulations, quizzes, quiz grading, video clips, 
show me, interactive assembly/disassembly of components 
and tracking student progress. 

The learning module is an interactive leaming tool that 
serves to teach, in realtime a SIMON user the detailed 
operation of a machine or process and the manner or 
carrying out repair or maintenance operations without the 
need to resort to hard copies or user's manuals. Training 
screens are displayed and allow users to interact with the 
application to leam about the customers system. 

While this invention has been described in reference to 
illustrative embodiments, this description is not intended to 
be construed in a limiting sense. Various modifications and 
combinations of the illustrative embodiments, as well as 
other embodiments of the invention, will be apparent to 
persons skilled in the art upon reference to the description. 
It is therefore intended that the appended claims encompass 
any such modifications or embodiments. 

What is claimed is: 

1. A portable instruction system for use at a location 
remote from a main computer wherein instructions relating 
to a site specific task at the user location are stored, 
comprising: 

a portable computer sufficiently small to be worn by a 
user; 

a memory connected to and under control of the com- 
puter; 

a display device that can receive display signals from the 
computer for visual display to the user; 

a video camera sufficiently small to be worn by the user; 

a system that transmits images from the video camera to 
a remote site; 

an instructional program that the computer accesses and 
stores in memory that contains instructional informa- 
tion concerning a task to be performed by the user, the 
program being stored in memory and responsive to a 
user command to display information to the program 
including a communications module for communicat- 
ing with an assistant at a remote location; and 

a communications system whereby the user interactively 
communicates with an assistant at the remote site 
concerning the task to be performed to request and 
receive instructions relating to the performance of the 
task as the assistant views the transmitted images. 

2. The system of claim 1 farther comprising a garment 
suitable for securing the computer on the user's body and 
means for mounting the computer on the garment. 

3. The system of claim 2 wherein the instructional pro- 
gram includes a program engine that contains program logic 
including one or more user assistance programs that can be 
accessed by the user through the program engine and 
whereby the program engine can access a database including 
data specific to the user's task. 

4. The system of claim 3 further comprising one or more 
search modules accessible by the program engine for search- 
ing a database specific to the user's task. 

5. The system of claim 3 wherein the task comprises a 
manual operation undertaken on an apparatus. 

6. The system of claim 5 wherein the task comprises 
maintenance performed on the apparatus. 

7. The system of claim 1 further comprising a data entry 
system connected to the computer whereby the user can 
enter data into a storage and retrieval device connected to 
and under the operation of the computer, the data relating to 
the user's task. 

8. The system of claim 1 wherein the communications 
system further comprises an audio system. 
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9. The system of claim 8 wherein the communications 
system includes a voice activated audio system. 

10. The system of claim 8 v^herein the communications 
system further comprises a keyboard for entering data to be 
communicated to the assistant. 

11. A method of performing a task at a remote location 
utilizing a portable instruction system for use at a location 
remote from a main computer wherein instructions relating 
to a site specific task at the user location are stored, 
comprising: 

utilizing a portable computer sufficiently small to be worn 
by a user, the computer including a memory connected 
to and under control of the computer; 

transmitting images relating to the task with a video 
camera sufficiently small to be worn by the user; 

utilizing an instructional program to provide information 
relating to the task, the computer accessing instruc- 
tional information stored in memory concerning the 
task to be performed by the user and responsive to a 
user command; 

displaying information provided by the instructional pro- 
gram for viewing by the user; and 

interactively communicating with an assistant at the 
remote site concerning the task to be performed to 
request and receive instructions relating to the perfor- 
mance of the task as the assistant views the transmitted 
images. 

12. The method of claim 11 further comprising wearing a 
garment suitable for securing the computer on the user's 
body and using means for mounting the computer on the 
garment. 

13. The method of claim 12 wherein the instructional 
program includes a program engine that contains program 
logic including one or more user assistance programs that 
can be accessed by the user through the program engine and 
wherein the program engine accesses a database to provide 
data specific to the user's task. 

14. The method of claim 13 further comprising using one 
or more search modules accessible by the program engine to 
search a database specific to the user's task. 

15. The method of claim 13 wherein the task comprises a 
manual operation undertaken on an apparatus. 

16. The method of 11 further comprising entering data 
relating to the task using a data entry system connected to 
the computer whereby the user enters data into a storage and 
retrieval device connected to and under the operation of the 
computer. 
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17. The method claim 11 wherein the step of interactively 
communicating with an assistant at the remote site further 
comprises using an audio system. 

18. The method of claim 17 wherein the step of interac- 
tively communicating with an assistant at the remote site 
communications system includes using a voice activated 
audio system. 

19. The method of claim 17 wherein the step of interac- 
tively communicating with an assistant at the remote site 
communications system further comprises using a keyboard 
to enter data to be communicated to the assistant. 

20. A portable instruction system for use at a location 
remote from a main computer wherein instructions relating 
to a site specific task at the user location are stored, 
comprising: 

a computer sufficiently small to be wom by a user and a 
memory connected to and under control of the com- 
puter; 

a display device that can receive display signals from the 
computer for visual display to the user; 

a video camera sufficiently small to be worn by the user, 
the video camera transmitting images from the video 
camera to a remote site; 

a communications system whereby the user interactively 
communicates with an assistant at the remote site 
concerning the task to be performed to request and 
receive instructions relating to the performance of the 
task as the assistant views the transmitted images; and 

wherein the computer utiUzes a communications module 
stored in the memory for communicating with an 
assistant at a remote location. 

21. The system of claim 20 further comprismg an instruc- 
tional program including a program engine that contains 
program logic including one or more user assistance pro- 
grams that can be accessed by the user through the program 
engine and wherein the program engine can access a data- 
base including data specific to the user's task. 

22. The system of claim 21 further comprising one or 
more search modules accessible by the program engine for 
searching a database specific to the user's task. 

23. The system of claim 20 further comprising a data entry 
system connected to the computer whereby the user can 
enter data into a storage and retrieval device connected to 
and under the operation of the computer, the data relating to 
the user's task. 
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